A change of variable formula with Ito correction term 



Krzysztof Burdzy * Jason Swanson^ 

University of Washington University of Central Florida 

May 1, 2008 



Abstract 

We consider the solution u{x, t) to a stochastic heat equation. For fixed x, the 
process F{t) = u{x,t) has a nontrivial quartic variation. It follows that F is not 
a semimartingale, so a stochastic integral with respect to F cannot be defined in 
the classical Ito sense. We show that for sufficiently differentiable functions g{x,t), 
a stochastic integral / g{F{t),t) dF{t) exists as a limit of discrete, midpoint style 
Riemann sums, where the limit is taken in distribution in the Skorohod space of cadlag 
functions. Moreover, we show that this integral satisfies a change of variables formula 
with a correction term that is an ordinary Ito integral with respect to a Brownian 
motion that is independent of F. 
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1 Introduction 

Recall that the classical Ito formula (i.e., change of variable formula) contains a "stochastic 
correction term" that is a Riemann integral. A purely intuitive conjecture is that the Ito 
integral itself may appear as a stochastic correction term in a change of variable formula when 
the underlying stochastic process has fourth order scaling properties. The first formula of 
this type was proved in [1], however, the "fourth order scaling" process considered in that 
paper was a highly abstract object with little intuitive appeal. The present article presents 
a change of variable formula with Ito correction term for a family of processes with fourth 
order local scaling properties; see (11. 5p and Corollary 16.41 

The process which is our primary focus is the solution, u{x,t), to the stochastic heat 
equation dtu = ^d^u + W{x,t), with initial conditions u{x, 0) = 0, where is a space-time 
white noise on R x [0, oo). That is, 

u{x,t) = / p{x — y,t — r)W{dy X dr), (1.1) 

jRx[0,t] 

where p{x,t) = (27rt)~-'^/^e~^'^''^* is the heat kernel. Let F{t) = u{x,t), where x G M is fixed. 
In the prequel to this paper [Tl], it is shown that F is a continuous, centered Gaussian 
process with covariance function 

pis, t) = EF{s)F{t) = (27r)-i/2(|t + s\^'^ - \t - s\^'^), (1.2) 

and that F has a nontrivial quartic variation. In particular, 

Y^\Fij/n)-F{ij-l)/n)\'^^ 

^-^ TT 

in l? . It follows that F is not a semimartingale, so a stochastic integral with respect to F 
cannot be defined in the classical Ito sense. In this paper, we complete the construction of 
a stochastic integral with respect to F which is a limit of discrete Riemann sums. 

More generally, we shall construct a stochastic integral with respect to any process X of 
the form A = cF + ^, where c G M and ^ is a stochastic process, independent of F, satisfying 

^ G C^((0,cx))) and / \^{t)\dt <oo a.s. (1.3) 

This allows us, for example, to consider solutions to (11.11) with non-zero initial conditions. 
Another example of such an A is fractional Brownian motion with Hurst parameter 1/4. 
See Examples 16.71 and 16.81 for more details. 
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For simplicity, we consider only evenly spaced partitions. That is, given a positive integer 
n, let At = n~^, tj = jAt, and AXj = X(tj) — X(tj^i). Let \_x\ denote the greatest integer 
less than or equal to x. For g G C(R x [0,oo)), we consider the midpoint-style Riemann 
sums 

[nt/2j 

I^{g,t) = J2 9{X{h,^,),h,^i){X{h,)-X{h,^2)). (1.4) 
i=i 

When X = F, we will simply write In rather than I^. 

In the construction of the classical Ito integral, the quadratic variation of the integrator 
plays a crucial role. Although the quadratic variation of X is infinite, the "alternating 
quadratic variation" of X is finite. That is, Q^{t) = ^j"*/^J(AX| - AX|^._ _-^) converges 
in law. If we denote the limit process by {X}t, then it is a simple corollary of the main 
result in [Tl] that {X}t is a Brownian motion which is independent of X. More specifically, 
{X,Q^) — > {XjKc^B), where 5 is a standard Brownian motion, independent of X, and 
K ~ 1.029. (See fl2.10p for the precise definition of n.) The convergence here is in law in the 
Skorohod space of cadlag functions from [0, oo) to M?, denoted by -0^2 [0, oo). 

We shall show that 1^(9, t) also converges in law. If g{X{s), s) dX{s) denotes a process 
with this limiting law, then our main result (Corollary l6.4l) is the following change of variables 
formula: 

g{Xit),t)=g{XiO),0)+ [ dM^is), s) ds 

Jo 

+ ^ d,g{X{s),s)dX{s) + ^j^ dlg{X{s),s)d{X},, 
where the equality is in law as processes. This can be rewritten as 

g{X{t),t) = g{X{0), 0) + f dtg{X{s), s) ds 

Jo 

+ [ d,g{X{s),s)dX{s) + ^ f dlg{X{s),s)dB{s), (1.5) 
Jo ^ Jo 

where this last integral is a classical Ito integral with respect to a standard Brownian motion 
that is independent of X. 

To state our results more completely, let F be a semimartingale and define 

/^'^(9,.^?,t) = ^7(X(t),t)-^7(X(0),0)- fdMX{s),s)ds-^ fdlg{X{s),s)dY{s). (1.6) 

Jo ^ Jo 

We show that [F,Ql,I^{d^g,-)) {F, kB, I^'^'^^id^g, ■)) in law in L)k3[0,oo), whenever 
g G C^'^(M X [0,cxd)). (See fl3.2l) - fl3.5p for the precise definition of the space C^'^. Also see 
Remarks 16.51 and 16.61 ) 

The benefit of having the convergence of this triple, rather than just the Riemann sums, 
can be seen if one considers two separate sequences of sums: {I^^{gi, ■)} and {I^'^{g2, ■)}• 
As n — > oo, these sequences will converge jointly in law. Separately, each limit will satisfy 
(11. 5p : and moreover, the Brownian motions which appear in the two limits will be identical. 
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In this sense, the Brownian motion in (11.51) depends only on F, and not on ^, c, or g. Clearly, 
this can be extended to any finite collection of sequences of Riemann sums. 

In the course of our analysis, we will also obtain the asymptotic behavior of the trapezoid- 
style sum, 

r„(,.t)^gg(ffc-.).'.-.) + g(^fe).'.)Af, (17) 

We shall see (Corollary US]) that Tn{d^g,t) g{F{t),t) - g{F{0),0) - Jl; dtg{F{s), s) ds 
uniformly on compacts in probability (ucp), whenever g G C^'^(M x [0, oo)). This result can 
be easily extended from F to X in a manner similar to the proof of Corollary 16. 4[ 

It is instructive to contrast these results with those of Russo, Vallois, and coauthors 
[SI El [121 [13], who, in the context of fractional Brownian motion, use a regularization 
procedure to transform these Riemann sums into integrals before passing to the limit. (Also 
see [2].) For instance, if g does not depend on t, then the regularized midpoint sum is 

^ 1^ g'{F{s)){F{s + e)- F{{s - e) V 0)) ds 
and the regularized trapezoid sum is 

i /^^'^^^^)) + + e)){F{s + e)- F{s)) ds. 

Asymptotically, as e — * 0, there is no difference between these two integrals. Hence, under 
the regularization procedure, the midpoint and trapezoid sums exhibit the same limiting 
behavior: they converge ucp to classical integrals. Under the discrete approach which we are 
following, however, we see new behavior for the midpoint sum: the emergence of a correction 
term which is a classical Ito integral against an independent Brownian motion. 

It should be noted that all of our convergence results rely on the fact that F is a quartic 
variation process. That is, 

CiAt^^ < EAFf < CaAt^^, (1.8) 

where H = 1/4. For example, the convergence of to a Brownian motion is made plausible 
by the fact that it is a sum of terms of the form AFj^ —AF2j_i, each of which is approximately 
mean zero with an approximate variance of At. If we replace F with a rougher process which 
satisfies (11.81) for some H < 1/4, then the midpoint sums will evidently diverge. On the 
other hand, the ucp convergence of the trapezoid sums Tn{dxg,t) remains plausible for any 
H > 1/6. This is consistent with the analogous results in [H [5] for regularized sums. 

The critical case for the trapezoid sum is if = 1/6. At the time of this writing, we know 
of only one result in this case. If g{x, t) = x^, then 

lnt\ 

Ud^g, t) ^ F{tf - F{Of + ^F'f- 

i=i 

(Here and in what follows, X„(t) ^ Yn{t) shall mean that X^ — Yn — >■ ucp.) If F is replaced 
with fractional Brownian motion with Hurst parameter if = 1/6, then this last sum converges 
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in law to a Brownian motion. (See [TT], for example.) It is natural to conjecture that a result 
analogous to (11.51) holds in this case as well. 

After the first draft of this paper had been finished, we received a preprint [9] from 
Ivan Nourdin and Anthony Reveillac, prepared independently of ours, and using different 
methods. That paper contains a number of results, one of which. Theorem 1.2, is a special 
case of our Corollary 16. 4[ Namely, if X = B^^^, fractional Brownian motion with Hurst 
parameter H = 1/4, if g does not depend on t, and if g satisfies an additional moment 
condition (see Hq in Section 3 of ^), then |9] gives the convergence in distribution of 
the scalar valued random variables I^{g',l). While [9] is devoted exclusively to fractional 
Brownian motion, it is mentioned in a footnote that a Girsanov type transformation can be 
used to extend the results from B^^^ to F. 

2 Preliminaries 

2.1 Tools for cadlag processes 

Here and in the remainder of this paper, C shall denote a constant whose value may change 
from line to line. 

Let D^d[0, oo) denote the space of cadlag functions from [0, oo) to M"^ endowed with the 
Skorohod topology. We use the notation x{t—) = \ims^tx{s) and Ax{t) = x{t) — x(t—). 
Note that if F„(t) = F{[nt\/n), then AF„(tj) = F{tj) - F{tj_i). As in Section [II we shall 
typically use AFj as a shorthand notation for AFn{tj). 

We note for future reference that if x is continuous, then x„ — > x in the Skorohod topology 
if and only if uniformly on compacts. For our convergence results, we shall use the 

following moment condition for relative compactness, which is a consequence of Theorem 
3.8.8 in [1]. 

Theorem 2.1 Let {X^} be a sequence of processes in D^d[0,oo). Let q{x) = |x|Al. Suppose 
that for each T > 0, there exist u > 0, l3 > 0, C > 0, and 6 > 1 such that 

(i) E[q{Xn{t + h)-Xn{t)Y/'^q{X^{t)-Xn{t-h)f/^] < Ch^ for alln andallO< t < T + 1, 
0<h<t; 

(ii) lim5^oSup„E[g(X„(5) -X,(0))^] = 0; and 
(ill) sup„E[|X„(T)r] < oo. 
Then {X^} is relatively compact. 

Corollary 2.2 Let he a sequence of processes in i5]Rd[0,oo). Let q{x) = \x\ A 1. Let 

(pi,(p2 be nonnegative functions of n such that s\iY)nn~^^i{n)if2{n) < oo. Suppose that for 
each T > 0, there exists u > 0, jS > 0, C > 0, and 6 > 1 such that sup„ £'[|X„(T)|''] < oo 



and 



E[q{X^it) - X^is)r] < g/^^2(n)bi(n)tJ-v.,(n)Ly.,(n).J 

\ n 



) 



e 



(2.1) 



for all n and all < s,t < T. Then {X„} is relatively compact. 
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Proof. We apply Theorem 12. 1[ By hypothesis, Condition (iii) holds. Taking s = and 
t = 6 in (12.11) gives Condition (ii). By Holder's inequality, 



E[q{X^it + h)- X^{t)YI'q{X^{t) - - /i))^/^] 

e/2 



^2{.n) L</?i(r^)(t + h)\ - (p2in) [(pi{n)t\ \ 
n J 

( y?2(n)[y?i(n)tj - ^2[n)\}px{n){t - h)\ \ ''^ 

\ n ) • 

If ipi{n)h < 1/2, then the right hand side of the above inequality is zero. Assume that 
ipi{n)h > 1/2. Then 

E[q{X4t + h)- X4t)f/'q{X4t) - X^t - h)f/'] 

< c(fiM:fiMh±iMy <c(h + < c{3hr, 



n J \ ipi[n 

which verifies Condition (i). □ 
In general, the relative compactness in Dik[0, oo) of {Xn} and {Yn} does not imply the 
relative compactness of {Xn + Yn}. This is because addition is not a continuous operation 
from Dm[0,cx3)^ to i5K[0, oo). It is, however, a continuous operation from _Dk2[0, oo) to 
Dir[0, oo). To make use of this, we shall need the following well-known result and its 
subsequent corollary. 

Lemma 2.3 Suppose Xn x in Dt^[Q, oo) and yn y in -Dr[0, oo). If Ax (t) Ay (t) = for 
all t > 0, then Xn + yn ^ x + y in D^[0, oo). 

Corollary 2.4 Suppose {Xn} and {Yn} are relatively compact in D^[0,oo). If every 
subsequential limit of {Yn} is continuous, then {Xn + Yn} is relatively compact. 

The following lemma is Problem 3.22(c) in [1]. 

Lemma 2.5 For fixed d > 2, {{X^, . . . , X^)} is relatively compact in D^d[0, oo) if and only 
if {X^} and {X^ + X^} are relatively compact in D^[0, oo) for all k and i. 

We will also need the following lemma, which connects relative compactness and 
convergence in probability. This is Lemma A2.1 in [3]. 

Lemma 2.6 Let {Xn},X be processes with sample paths in D]^d[0, oo) defined on the same 
probability space. Suppose that {Xn} is relatively compact in D^d[0, oo) and that for a dense 
set H C [0, oo), Xn{t) —>■ X{t) in probability for all t & H . Then Xn ^ X in probability in 
Z?]Rd[0, oo). In particular, if X is continuous, then Xn —>■ X ucp. 

Our primary tool is the following theorem, which is a special case of Theorem 2.2 in [7j. 
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Theorem 2.7 For each n, let Yn he a cadlag, -valued semimartingale with respect to a 
filtration {J^"}. Suppose that Yn = M„ + An, where Mn is an {J-'l^}-local martingale and 
is a finite variation process, and that 

sup E[[Mn]t + Vt{An)] < oo (2.2) 

n 

for each t > 0, where Vt{An) is the total variation of An on [0,t] and [Mn] is the quadratic 
variation of Mn- Let Xn be a cadlag, {J-'J^}- adapted, M.^^^-valued process and define 

Zn{t)= f Xn{s-)dYn{s). 

Jo 

Suppose that {Xn,Yn) (-^7^) in lo-w in DjjfcxmxigmjO, 00). Then Y is a semimartingale 
with respect to a filtration to which X and Y are adapted, and (X„, Yn-, Zn) — ^ {X, Y, Z) in 
law in D]RfcxmxMmxiRfc [0, cxo), where 

Z{t) = ! X{s-)dY{s). 
Jo 

If {Xn, Yn) — * (X, Y) in probability, then Zn Z in probability. 

Remark 2.8 In the setting of Theorem 12. 7[ if is another sequence of cadlag, {J^"}- 

adapted, M^-valued processes, and (iy„,, X„, F„) —> {W^X^Y) in law in Dk^xm^x^xr™ [0, 00), 
then {Wn, Xn, Yn, Zn) — > {W, X, Y, Z) in law in D]^^ xr^x^xr^xm* [0, 00). This can be seen by 
applying Theorem 12. 71 to {Xn, Yn), where Xn is the block diagonal {k + i) x (m + 1) matrix 
with upper-left entry Wn and lower-right entry Xn, and Yn = (0, Y^)'^ ■ 



2.2 Estimates from the prequel 

We now recall some of the basic estimates from [1 
By (2.6) in [H], for all s <t, 

\E\F{t) - F{s)\^ - (2/7r)i/2|t _ s\^'^\ < n^'^^l + 2'/^)-H~^/^\t - 

Hence, 

7r-V2|^ - s|i/2 < E\F{t) - F{s)\^ < 2\t - s\'/\ (2.3) 
In particular, if (t| = EAF^, then 

|a| - {2/n)'/'At'/^\ < tf^At^ = r'^'^At'/\ (2.4) 

and 

^-1/2^^1/2 < ^2 < 2Ati/2_ (2.5) 

Theorem 2.3 in [14] shows that F has a nontrivial quartic variation. A special case of this 
theorem is the fact that X]j-=i ^ Qt/n ucp. The proof can be easily adapted to show 
that 

[nt] [nt] 

^Ai^^^-t and E^^'--^ (2-6) 

j odd j even 



ucp. 

Let 

7, = 2//^-(j-l)^/^-(j + l)^^ (2.7) 
and note that Yl'jLilj = 1- By (2.4) in [T3j, if i < j, then 

\E[AE,AF,] + (27r)-i/%,-_,Ati/2| < {U + t,)"'^'^^^ = (t + jy^^At'^^ . 
Some related estimates are < 7j < 2-1/2^-3/2^ which is (2.8) in [14], and 

- 2{tj - U)-'"^Ae = -2(j - z)-3/2Ati/2 < ^[AFiAF,] < 0, (2.8) 

which precedes (2.10) in |14j . 

Let dj = E[F{tj^i)AFj]. Since 

j-l oo 

a, + {2ny'/'At'/' = J^iE^AF,] + (2^^/'^,^^^') + (27r)-V2Ati/2 ^ 
it follows that 

\a, + (27r)-i/2Ati/2| < Cr'^'^At'/^. (2.9) 
In particular, \aj\ < CAt^/^ and - {2TxY^At\ < Cj^^/^At. 

Lemma 2.9 // integers c, i and j satisfy < c < i < j , then 

(i) \E[{F{t,.,) - F(g)AF,]| < CAt^l\{j - z) V l)-i/2. 

rzz; |i?[(F(t,_i) - F{t,))AF:^\ < CAt^l%{j - z) V 1)-V2 + _ c)-V2]. 
fzn; |E[F(Vi)AF,]| < CAti/2((j - z) v l)-!/^. 

Proof. By ([23]), 

|E[(F(t,.i)-^(tc))AF,]|< \E[AF,AF,]\<CAt'/^ E " ^)"'^'- 

fc=c+l fc=c+l 

Hence, 

oo 

\E[{F{t,^,)-F{t,))AF^^\<CAt^" ^^'"^ 

k=j—i+l 

which proves the first claim. 

For the second and third claims, it is easy to see that they hold when z > j — 1. Assume 
i < j - 1. Note that 

E[F{tj^i)AF.i\ = p(ti,t,-_i) -p(ti„i,t,_i) 

= p{ti-i + At,tj_i) - p{ti_i,tj_i) 
= Atdsp{t,-i + eAt,tj-i) 



for some 6 G (0,1). Since j > i, + 9At < tj^i. In the regime s < t, dsp{s,t) = 
(87r)-i/2((i + syi/2 + _ s)-i/2). Hence, < 9,p(s,t) < C{t - s)-^/'^. It follows that 

< E[F{tj^i)AFi] < CAt\tj^i - _ cAt^/^ij - i - ly'/^. 

Since j — i > 2, this implies E[F{tj_i)AFi] < CAt^/^(j — which proves the third 

claim. Combining this with the first claim gives 

|E[(F(t,„i) - F{Q)AF,]\ < |E[F(t,_i)AF,]| + \E[F{QAF,]\ 

<CAt'/^[U-t)-'/' + it-cr'/% 

which proves the second claim. □ 
Recall 7j, defined by (12.71) . Let 

4 2 — ^ "^^^ 



+ >0' (2.10) 

(the quantity in the brackets is strictly positive by Proposition 4.7 of [H]) and define 

2[nt/2\ 

B,,{t) = K~' ^F'i-^y- (2-11) 
i=i 

(Note that this is simply k,~^Q^, in the notation of Section [TJ) By Propositions 3.5 and 4.7 
in [Hj, 



2[nt/2\ -2[ns/2j 



E\Bn{t) - 5„(s)r < C{ '—^ (2.12) 



n 



2 



for all s and t. Recall that F{t) = u{x,t), where u is given by (11. ip . Let m denote Lebesgue 
measure and define the filtration 

= a{W{A) : A C M X [0, t], m(A) < oo}. (2.13) 

Fix r > and define G(t) = F(t + r) — E[F{t + r) | J^r]- In the proof of Lemma 3.6 in 
[11], it was shown that G and F have the same law, and that G is independent of Jv. In 
particular, if j > c and AFj = AFj — E[AFj \ !Ft^, then AFj is independent of J-*^ and 
equal in law to AFj_c. 

According to the displayed equation above (3.32) in [H], if < r < s < t, then 

E\E[F{t) - F{s) I Tr\? < 2\t - s\^\t - rj-^/l (2.14) 

In particular, E\AFj - AF^-p < 2At^{tj - t^y^/"^ = 2At^/^{i - c)^^/^ which, together with 
(12. 5p and Holder's inequality, implies 

E|AF/ - Af]\^ = E[\AFj + AFj\''\AFj - AF^f ] 

< CkAt^'^/^t, - t,)-"^^'^ = CkAt^'^U - c)-=^^/^ (2.15) 

Finally, we recall the main result of interest to us, which is Proposition 4.7 in [I4] . 



Theorem 2.10 Let {Bn} he given by (12. lip and let B be a standard Brownian motion, 
independent of F. Then {F,Bn) — > {F^B) in law in Dk2[0, cxd). 
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2.3 Tools for Gaussian random variables 

Let 

hn{x) = (-l)"e^'/'£;r(e"^'^') (2-16) 

be the n-th Hermite polynomial, so that {hn\ is an orthogonal basis of where 
^l{dx) = (27r)-i/2g-xV2^a;. (See Section 1.1.1 of [10] for details.) Let || ■ || and (■,■) denote 
the norm and inner product, respectively, in L^(/i). 

The first few Hermite polynomials are ho{x) = 1, hi{x) = x, h2{x) = x"^ — 1, and 
^3(3;) = x^ — 3x. We adopt the convention that h^i{x) = 0. The Hermite polynomials 
satisfy the following identities for n > 0: 

h'^ix) =nhn-i{x), (2.17) 
xhn{x) = hn+i{x) + nhn-i{x), (2.18) 

hn{-x) = i-irhnix). (2.19) 

Any polynomial can be written as a linear combination of hermite polynomials by using the 
formula 

Ln/2J 

^'^= E Qj(2j-l)!!/.n-2,(x), (2.20) 
where (2n — j)!! = (2j — l)(2j — 3)(2j — 5) ■ ■ ■ 1. Note that this can be rewritten as 

^" = E('')^[^']^-^(^)' (2-21) 

where F is a standard normal random variable. 

In the remaining part of Section 12.31 X shall denote a standard normal random variable. 
If r G [—1,1], then Xr, Yr shall denote jointly normal random variables with mean zero, 
variance one, and £'[XrFr] = f'- By Lemma 1.1.1 in [TO] . 



(D if T? ^ TD 

, n (2-22) 
nlr n n = m. 

In particular, ||/in|P = E[hn{X)'^] = n\. Hence, ii g E L'^ifi), then 

00 ^ 

9 = yZ~i(9,K)hn, (2.23) 

n=0 

where the convergence is in L'^{fi). 

If g and g' have polynomial growth and n > 1, then integration by parts gives 

{g,h^) = g{x)hr,{x)e-^'/'dx = ^ J g{x)£^{e-^'/') dx 



^'(^)T^(e"''^') = K^,). (2.24) 



J ^ ' dx"-' 
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That is, E[g{X)hn{X)] = E[g'{X)hn-i{X)]. Using (12:22|) and I^M), we can generalize this 
as follows: 



CXj 

E[g{Xr)h4Yr)] = V —{g,h^)E[hUXr)K{Yr)] 
^-^ ml 

m=0 

= {g, K)r^ = r{g', /i„_i)r"-^ = rE[g'{Xr.)K.^{Yr)]. (2.25) 
The following two lemmas will be useful in Section [51 

Lemma 2.11 Suppose g, h,g', h' all have polynomial growth. If f{r) = E[g{Xr)h{Yr)], then 
fir) = E[g'{Xr)h'iYr)] for all r E (-1,1). 

Proof. By and fir) = En=oM9^hn){h,hn)r^, which, by (^M>, gives 



n=l ^ 



n-l 



OO ^ 

J2-r^^{9',K^^){h',h^^,)r--' = E[g'{Xr)h'{Xr)]. 

n=l ^ ' 



□ 



Lemma 2.12 Suppose g, g', g", h, h', h" have polynomial growth. Let U = aX^ and V = hY^. 

If ip{aM = E[g{U)h{y)], then 



dip 
da 



.b,r)= aE[g"{U)h{V)] + brE[g'{U)h'{V)] 



for all real a,b and all r G (—1, 1). 

Proof. By and (^M. vMr) = j:Zohi9ia-),h^){h{b-),h„)r". Fix ao G M. To 

justify differentiating under the summation at oq, we must show that there exists an e > 
and a sequence C„(6, r) such that 



d 



da 



■((?(a-),MW-)»" 



<Cnib,r) 



for all |a — Ool < s, and Yl'^=o^nib,r) < oo. For this, we use (12.181) and (I2.24p to compute 



d_ 

da 



■{g{a-),hn){h{b-),hn)r'' 



-{g'ia-),hn+i){h{b-),hnK 

■{g'{a-),k^_,){hib-),k^)r'' 



(n-l) 



+ 



-{g"{a-),h^){h{b-),h^y 



(n-l)! 
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{g'{a-), hn-i) {h'{b-), hn-i)r^ 



Since |(-, hn/yn\) \ < || ■ ||, we may take Cn{b,r) = Mr^ for an appropriately chosen constant 
M, provided |r| < 1. We may therefore differentiate under the summation at Qq- Since Oq 
was arbitrary, we have 



rj OO _ OO _ 

^(a, b,r) = a ^(/(a-), K.) {Kb-), h^K + b J2 T^^^^idia-), h^-i) {h'{b-), K-i)r^ 

n=0 ■ n=l ^ '' 

= aE[g"{U)h{V)]+brE[g\U)h\V)] 



for all a,6, r with |r| < 1. □ 
2.4 Mult i- indices and Taylor's theorem 

We recall here the standard multi-index notation. A multi- index is a vector a G 'L'^, where 
Z+ = N U {0}. We use to denote the multi-index with e^- = 1 and el = for i 7^ j. If 

a G Zi and x G M"', then 



d d 

\a\ = a! = JJ^aj!, 

i=i i=i 

J j=l 



Note that by convention, 0° = 1. Also note that = y", where yj = \xj\ for all j. 
Taylor's theorem with integral remainder states that ii g E C'^"^^(M), then 

k ■ ij 

m = J2 9''\ai^^ + r[ / - ufa^'^-'X^) du. (2.26) 

Taylor's theorem in higher dimensions is the following. 
Theorem 2.13 If g E C^+^{W^), then 

9ib)=J2d''9ia)^-^^ + R, 

\a\<k 

where ^ 

R = (k + 1) y i^Z^ /" n-u)''d"g(a + u(b-a))du. 

In particular, 

\R\ < |6-ar+\ 

where M = su.p{\d°' g{a + u{b — a))\ :0<'u<l,|a| = k + 1}. 
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For integers a and b with a > 0, we adopt the convention that 



We define 




for any multi-indices 7 and a. Later in the paper, we shall need the following two 
combinatorial lemmas. 



Lemma 2.14 Let a, b and c be integers. If a > and < c < a, then 



j=0 



a — c \ / c 



b - jj \j 



Proof. The proof is by induction on a. For a = 0, the lemma is trivial. Suppose the 
lemma holds for a — 1. Since the lemma clearly holds for c = or c = a, we may assume 
< c < a — 1. In that case, 



a — 1 
b 



a — 1 



j=0 



a — 1 — c 
b-J 



a — 1 — c 



E 

j=0 



a — c\ c 



b-J J \J 



Suppose a and 7 are multi- indices. We will write a < 7 if < 7^ for all j. 
Lemma 2.15 If 'j is a multi-index in lA. and m > 0, then 



E 

\a\=in 
a<7 



□ 



Proof. We shall prove this by induction on d. If d = 1, the lemma is trivial. Suppose the 
lemma is true for d — 1. Let 7 be a multi-index in and fix m with < m < |7|. For 
multi-indices a and 7, let a = (ai, . . . , a^-i) and 7 = (71, . . . , 7d-i). Then 



E 

|a|=m 
a<7 



E,E 

\a\=m—aj 
S<7 



1\ Id 

a) \ad 



E 

ad=0 



I7l \ Id 
m - ad) \ad 



Id 

E 



7l - Id 



m - OLd \OLd 



Id 



Applying Lemma 12.141 completes the proof. 



□ 
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3 Fourth order integrals 

Theorem 3.1 Suppose : M x [0, oo) — M continuous. For each n, let {s*} and {t*} he 
collections of points with s*,t* G Then 

lim J2 9iF{s*),t*)AF^ = lim 9iF{s*),t*)AF} = - / g{F{s),s)ds, (3.1) 
i=i j=i 

J odd J even 

where the convergence is ucp. 

Proof. We prove only the first hmit. The proof for the other limit is nearly identical. Let 

oo 

^n(t) = $^^7(F(s*),t*)l[,,_„,,)W> 



and 



= AF} 



j odd 



SO that 



V^?(F(s*),t*)AF/= / X^{s-)dA^{s 
,-1 Jo 



3=1 
j odd 

By ( 12.61) . An{t) St/n ucp. Also, by the continuity of g and F, X„ — > (yf(F(-),-) ucp. 
Finally, note that the expected total variation Vt{An) of An on [0, t] is uniformly bounded in 
n. That is, 

[nfj [nt] 

E[Vt{An)] = J2 ^^^t < At < Ct. 
i=i j=i 

J odd 

By Theorem 12.71 (13. ip holds with the convergence being in probability in D]r[0,oo). Since 
the limit is continuous, (13. ip holds ucp. □ 
We shall use the notation g G C'^'^(]R x [0, oo)) to mean that 

(7 : M X [0, oo) ^ M is continuous, (3.2) 
di.g exists and is continuous on M x [0, oo) for all j < k, (3.3) 
dtdlg exists and is continuous on M x (0, oo) for all j < k AA, (3.4) 

/ sup \dtdlg{x, t) \ dt < oo for all compact K C M and all j < k A A. (3.5) 

For functions of one spatial dimension, we shall henceforth use standard prime notation to 
denote spatial derivatives. For example, g" = d^g and g^'^^ = d^g. 

Typically, we shall need (13.40 and (13. 5p only when j = 0. There are a few places, however, 
where j > is needed. We need j = 3 in the derivation of (I3.10p . which is used in the proofs 
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of both Theorem 13.31 and Corollary 14.51 We need j = 2 in the proof of Lemma 15. 8[ And we 
need j = 4 in the proof of Theorem 16. 2[ 

Recall that ^ Yn{t) means that X„ — 1^ — > ucp. 

Theorem 3.2 If g e C^'\R x [0,cx))), then 

l4g',t)^g{F{t),t)-g{F{0),0)- [ dtg{F{s), s) ds 

Jo 

lnt/2\ 

-g E /'W2,-i),t2,-i)(AFj + A4_,), 

where In{g,t) is given by (11.40 . 
Proof. By (|2:26D . 

g{x + /ii, t) - g{x + h2,t) = J2- 9^^\^^ ^Wi - ^2) + R{x. h,t) - R{x, /i2, t), 

i=i 



where 



1 

h,t) = — {h- ufg^^'^ (x + u, t) du. 

4! ./n 



Taking a; = F{t2j-i), hi = AF2j, and /i2 = — AF2j_i, we have 

^?(i^(t2,),t2,-i) -^?(F(t2,-2),t2,-i) = 5^-^?(^)(F(t2,_i),t2,-i)(AF|^- " AFi^^,) 

+ R{F{t2j^i), AF2j, t2j~i) — R{F{t2j^i), — AF2j_i, t2j-i). 

Let A^(t) = 2[nt/2\/n. That is, if t G [^2^-2,^2^), then N{t) = t2j-2- Let = F(iV(t)). 

Then 



g{F{t2j)Mj) - g{F{t2j)Mj-i) = dtg{Fn{s + At), s) ds 

''t2j-l 

rt2j~i 

g{F{t2j-2),t2j-i) - g{F{t2j-2),t2j-2) = / dtg{Fn{s), s) ds 

J toi — O 



dtgiFnis + At),s)ds. 

*2j-2 
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Thus, 



[nt/2j 



9{F{t),t) = 9{F{0),0) + {9{F{h,)M,) - 9 {F{t2, -.2)^,-2)] 

i=i 

+ 9{F{t),t)-9{F^{t),N{t)) 
rN{t) 

= (7(F(0),0)+ / dt9{Fn{s + ^t),s)ds + In{9\t) 
Jo 



[nt/2\ 



\ E 9"{F{t,,.^)M,-i){^Fl-AFl_,] 



i=i 

\nt/2\ 



+ ^ E 9"'{nt2,-i)Mo-i){^Fl + ^Fl^-i)+en{9.t). 



where 



[nt/2\ 



en{9.t) = ^ E 9^'\F{t2,-i)Mj-i){^F^,-^F^,-,] 



[nt/2j 

+ E {R{F{h,-i)AF2jM3-i) - R{F{h,-,),-/^F2,-iM,-,)} 

+ ^7(F(t),t)-^?(F„(t),iV(t)). (3.6) 
By (13 ■4p . (13. 5p . the continuity of F, and dominated convergence, 



7V(i) 



dt9{Fn{s + ^t),s)ds-^ / 9t(7(F(s),s)c/s 



uniformly on compacts, with probabihty one. Therefore, it will suffice to show that 

^n{9,t) UCp. 

First assume that 9 has compact support. By the continuity of 9 and the almost sure 

continuity of F, 9{F{t),t) - 9{Fn{t), N{t)) ucp. Since ^(s) jg bounded, \R{x,h,t)\ < 
C\h\^. Thus, 



[nt/2\ 

E {i?(F(t2,_l),AF2„t2,_l) -i?(F(t2,-i),-AF2,_i,t2,_i)} 



[nt/2\ 



< c E lAi^. 



5 



and 



E 



sup 

0<t<T 



[nt/2j 



Ln,T/2j L«r/2J 

E E\AFj\^ = C E (y] <CnT/\r'l^ = CTM^'\ 
i=i i=i 



It follows that 



[nt/2j 

E {i?(F(t2i-l), AF2,-,t2i-l) - ^(i"(t2,-l), -AF2,„i,t2,_l)} ^ 
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ucp. An application of Theorem 13.11 to the first sum in (13. 6p completes the proof that 
^n{.9)i) ~^ ucp, in the case that g has compact support. 

To deal with the general case, we use the following truncation argument, which we will 
make use of several times throughout this paper. Fix T > and r] > 0. Choose L > T so 
large that 



Pi sup \F{t)\ >L]<r]. 

V 0<t<T J 

Let (f G C°°(M) have compact support with if = 1 on [—L,L]. Define h{x,t) = 
g{x,t)ip{x)ip{t). Then h G C^'^(M x [0,oo)), h has compact support, and h = g on 
[—L,L] X [0,T]. By the above, we may choose uq such that 



Pi sup \en{h,t)\ >ri] <ri 

0<t<T 



for all n > no- Hence, 



Pi sup \en{g,t)\> T]] < Pi sup \F{t)\>L]+Pi sup t)| > r/ < 2r/ 

\0<t<T / \o<t<T / \o<t<r / 

for all n > no, which shows that en{g,t) — > ucp and completes the proof. □ 
Theorem 3.3 If g e C^^\R x [0,oo)), then 

T4g',t) ^ giFit),t) - giFiO),0) - [ dtg{Fis), s) ds 

Jo 

[nt] 

where Tn{g,t) is given by (11.71) . 

Proof. As in the proof of Theorem 13. 2[ we may assume g has compact support. Define 

[nt/2\ 

Tn{g,t)= J2 9iF{t2j),t2j){F{t2j+l) - F{t2j-l)). 

The proof of Theorem 13.21 can be easily adapted to show that 

Ug', t) ^ giF{t),t) - giF{0), 0) - T dtgiFis), s) ds 

Jo 

[nt/2i 

i=i 

\nt/2\ 

-« E /'(i^(t2,),t2,)(A4H_i + A4). (3.7) 



6 
j=i 
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Note that 

2[nt/2j 2[nt/2j 

In{9',t)+Ug',t)= 9'{F{t,),tj){AF,^, + AF,)+ 9'{F{tj),t^){AF^+, + AF, 

i=i i=i 

j odd j even 

2[nt/2j 

= 9{F{t,),t,){AF,^, + AF,). 

Also note that 

lnt\-l [nt] . 

Tn{g',t) = -i J2 9'{F{t,),t,)AF,+, + Y,9'{F{t,),t,)AFX 
V j=o i=o ^ 

By the continuity of F and this shows that 
By ( 13. 7p and Theorem 13.21 



T„((7',t)^(7(F(t),t)-(7(F(0),0)- / dtg{F{s), s) ds 

Jo 



lnt\ 

+ i J2(9"{F{t,),t,)-g"{F{t,_,),t,^,))AF; 



+ (3.8) 
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Since G C^'"'^(]R x [0, oo)), we may use the Taylor expansion f{b) — f{a) = | (/'(a) + 
- a) + Oi\b - a|3) with / = g" to obtain 



+ Vi) + /'(F(t,),t,_i))AF, + R 



r dtg"iF{t,),s)ds-lAFj r dtg"'{F{t,),s)ds 



+ + /'(F(t,),t,))AF, + R 



III I 

2'" 

(3.9) 



where \R\ < C|AFjp. Since g has compact support, we may use (13.51) with K = M. and 
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j = 3 to conclude that the above integrals are bounded by CAt. This yields 

\nt\ 

= Y.2^9"'{F{t,),t,)+g"'{F{t,.,),t,.,))AFf + R, (3.10) 
i=i 

where \R\ < CY.{AtAFf + At\AFj\^ + \AFj\^). We can combine this formula with i^M) to 
complete the proof. □ 

4 Third order integrals 

To analyze the third order integrals, we shall need a Taylor expansion of a different kind. 
That is, we shall need an expansion for the expectation of functions of jointly Gaussian 
random variables. For this Gaussian version of Taylor's theorem, we first introduce some 
terminology. We shall say that a function : M*^ — > M has polynomial growth if there exist 
positive constants K and r such that 

|^(x)| < K{1 + IxH 

for all X G Mf^. If k is nonnegative integer, we shall say that a function g has polynomial 
growth of order k ii g E C^{W^) and there exist positive constants K and r such that 

< K{i + \xY) 

for all X G M*^ and all |a| <k. 

Theorem 4.1 Let k he a nonnegative integer. Suppose /i : M — M zs measurable and has 
polynomial growth, and f G C^^^{M.'^) has polynomial growth of order k+1, both with common 
constants K and r . Let ^ G M*^ and F G M 6e jointly normal with mean zero. Suppose that 
EY"^ = 1 and < u for some u > 0. Define p eM.'^ by pj = E[^jY]. Then 

E[fmiY)] = ^ -p"E[dy{^-pY)]E[Y\'^\h{Y)] + R, 

\a\<k 

where \R\ < C|p|^^^ and C depends only on K, r, v, k, and d. 

Proof. hetU = i-pY and define : M"^ ^ M by ip{x) = E[f{U + xY)h{Y)]. Since h 
and / have polynomial growth, and all derivatives of / up to order k + 1 have polynomial 
growth, we may differentiate under the expectation and conclude that ip G C^^^iW^). Hence, 
by Theorem 12.131 and the fact that U and Y are independent, 

E[f{my)] = vip) = E Ap"5V(o) 

^ — ' al 

\a\<k 

= - p"E[dVXU)]E[Y\-\hiY)]+R, 

\a\<k 
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where 

\R\ < ^^k^\p\'^'^ 

and M = sup{|9"^(Mp) | : < m < 1, |a| = A; + 1}. Note that 

d'^ifiup) = E[9"/(f/ + upY)Y''+'h(Y)] = E[d''fi^ - p(l - u)Y)Y''^'h{Y)]. 

Hence, 

< K'E[ii + le - p(i - u)Yn\Y\'^^\i + \Yn] 

Since |pp < ud, this completes the proof. □ 

Corollary 4.2 Recall the Hermite polynomials hn{x) from (12.161) . Under the hypotheses of 
Theorem \4-l\ 

\a\<k 

where \R\ < C\p\^^^ and C depends only on K , r, v, k, and d. 
Proof. Recursively define the sequences 

{af )}°^o by af = E[Y^h{Y)] and 



aj""^ if j < 



We will show that for all < n < A; + 1, 

E[f{OKY)]= E E 3P"^[^"/(e-P>^)]«S+^, (4.2) 



|o|<n— 1 n<\a\<k 



where \R\ < C\p\^^^ and C depends only on r, u, k, and d. The proof is by induction on 
n. The case n = is given by Theorem 14.11 Suppose (14. 2 p holds for some n < k + 1. Fix a 
such that |a| = n. Let Cfc denote Applying Theorem 14. II to 9"/ with h{y) = 1 gives 



^[5°/(0]= E ^P^E[d'^-'f'f{^-pY)]c\p\+R 

= E[dy{^ - pY)] + ^ 1 p^i?[9"+'^/(e - pY)]c\p\ + i?, 



l<l/3|<fc-ri 

where |^| < Clpl'^+i-". Hence, by fOj) . 

E[/(OM>^)] = E ^p"^r + E - py)]^H -s + R*, (4.3) 



\a\<:n n+l<|a|<fc 



20 



where \R*\ < C|p|''+^ and 

\a\=n l<|/3|<fc— n 

Making the change of index 7 = a + /3 and using Lemma 12.151 gives 

n+l<|7|<fc |Q|=n 
n+l<|7|<fc ^ ^ 

Substituting this into (14. 3 p and using fl4.ip shows that 

|a|<n n+l<\a\<k 

which completes the induction. 

By (14. 2 p with n = k + 1, it remains only to show that 

af ^ = E[hj{Y)h{Y)] for all j < n. (4.4) 

The proof is by induction on n. For n = 0, the claim is trivial. Suppose (14. 4p holds for all 
n<N. If j < N, then (gl]) implies 4^+^^ = af^ = E[hj{Y)h{Y)]. If j = iV + 1, then 



Using induction, this gives 



- r ^^)E[h,{Y)h{Y)]E[Y^+^~^] 



j=0 

By dm, 

Hence, a^J^Y^ = ^[^Jv+i(>")/i(l")], completing the proof of (1121). □ 
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Theorem 4.3 If g e C^'^ 

[nt] 



X [0, oo)), then 

[nt] 



lim J^g{F{t,^,),t,.,)AFf= lim ^ giF{t,.,),t,.,)AFf = [ g'{F{s),s)ds 

J odd J even 



(4.5) 



and 



lim 5^ (?(F(t,),t,)Ai^3 ^ ^ ^(F(t,),t,)AF,3 ^ / ,) rf,, (4.5) 



J odd 



where the convergence is ucp. 



J even 



Remark 4.4 The non-zero hmits resuh from the dependence between F{tj-i) and AFj in 
fli3|) . and and AF^- in (gl]). Note that E[F(tj_i)AFj] = Atdtp{tj_i,tj_i + e), for some 
< e < At. Similarly, E[F{tj)AFj] = Atdtp{tj, tj — e). If X is a centered, quartic variation 
Gaussian process, then 



p{s, t) = -{EX{tf + EX{sf - E\X{t) - X{s) 



1 



{EX{tf + EX{sf -\t- s\^'^) 



which means the leading term in dtp{s, t) is — |t — s| sgn(t — s). Hence, it is not surprising 
that the limits in (14. 5 p and (14.61) are of equal magnitude and opposite sign. 

Proof. We prove only the case for odd indices. The proof for even indices is nearly identical. 
To abbreviate notation, we shall not explicitly indicate that the indices are odd in the 
subscript of the summation symbol (this convention applies only in this proof). 

Using the truncation argument in the proof of Theorem 13.21 we may assume that g has 
compact support. Fix T > 0. Let 0<s<t<Tbe arbitrary. Recall aj and aj from Section 
O Let 

\nt\ 

Zn{t) = J2g{F{t,_,),t,.^)AFf, 
i=i 

Xn = Xn{s,t) = Zn(t) - Z„(s), 

[nt] 

Yn = Yn{s,t)=3 Yl 9'{F{t,_^),t,.^)a,al 

j=[ns\+l 



We may write 



E\Xn — Yn\ 



E 



[nt\ 



\nt\ 



J2 g{F{t^^,),t,_,)AFf-3 Yl 9{F{t,.,),t,.,)a,a 

j=lns\+l j = lns\+l 

{Si — S2) — {S2 — S3), 
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where 

^1= E E E[giFiU.,),t,.,)AF,^giFit,.^),t,.,)AFfl 

i= \ns\ +1 j= \ns\ +1 
\nt\ \nt\ 

^2 = 3 E E E[g{F{U^{),t,^,)AFfg\F{t,^,),t,^{)]d,al 

i= \ns\ +1 j= [nsJ+1 
\nt\ \nt\ 

^^3 = 9 E E E[g\F{U_{),tj_^)g\F{t,_^),t,_^)]dia^^d,al 

i= [nsj +1 J = [nsj +1 

Let ei = F(t^-i), 6 = ariAF,, = F{t,_,), Y = aj'AFj, and pk = E[^,Y]. Define 
/ G C3(]R3) by /(x) = g{xi,tj_i)xlg{x3,tj_i) and define = x^. By Corollary 14.21 with 
A; = 2, 

|ol<2 ' |a|=l 

where \R\ < C\pf. Hence, 

[nt] [nt] 

\Si-S,\= Yl E ^f^'iE[f(0Y']-3psE[d,fm 

i= \ns\ +1 j= \ns\ +1 
\nt\ \nt\ 

E E ^^|(IPll + IP2| + |P3|') 
j=[nsj+l j=\ns\+l 
\nt\ \nt\ 

<C Y {At^'^\EF{ti_i)AF.j\+ At\EAF,AFj\+ At^/^\dj\'^). 

i= \ns\+l j= [ns] +1 

By ^M, O, Lemma EnKi) with c = 0, and Lemma [HJ^iii), 

[nt] [nt] 

\S,-S2\<C Yl E (At'/'(|j-^| V 1)^1/2 + At3/2(|^._ ^1^^)^.3/2 ^^^9/4) 

i=[nsj+l j=LnsJ+l 
[nt] 



i= [ns\ +1 
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To estimate 5*2 — S'3, let ^1 = ^2 = F(tj_i), Y = "^AFj, and pk = E[^ky]- Define 

/ G C^(M^) by /(x) = g{xi,tj^i)g'{x2,tj^i) and h{x) = x^. As above, 

[nt] [nt] 

1^2-^31 = 3 J2 E ^^^]^KE[fiOY']-3p,E[djm 

i= \ns\ +1 j= [nsJ+1 
\nt\ \nt\ 

<c E E \^M>K\P2\ + \Pi?) 

i= [nsJ+1 j= [ns] +1 
[nt] [nt] 

<C Yl (At'(|j-^l Vl)-^/2 + At5/2) 

i=[nsj+l j = [nsj+l 



j= [nsJ+1 

Combining these results, we have 



5/4 



Note that 



[nt] [nt\ 
i= [ns] +1 J= [nsj +1 



^ 2^ 2| ^ 



i= Ins 1+1 7= Ins 1+1 ^ 



Since t — s <T, this shows 

E|Z„(t)-Z„(s)|2 = EX2<C 



[ntj — [nsj 



3/2 



Taking s = verifies Condition (iii) of Theorem 12.11 Hence, by Corollary 12.21 {Zn} is 
relatively compact. Since Xn — — ^ in it will suffice, by Lemma [2^ to show that 

L"*J o rt 

Fn(0,t) = 3 5^^?'(F(t,_i),Vi)a,a|-.-- / g\Fis),s)ds 

j=l ^ -'0 

in probability. For this, observe that by (12.41) and (12. 9p . 



Hence, 



[nt] ^ 



< CAt^/2 ^ Q_ 
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Since 

\nt\ 



A 1 '-'0 



i odd 



almost surely, this completes the proof of (14. 5p . 

For (14.61) . note that we may use (13. 5p with K = M. and j = to obtain 



= g'{F{t,.^),t,.,)AF^+R, 
where \R\ < C{At + AFf). Hence, 

[nt] [nij [nt] 

Y,9{F{t,),t,)AFf = Y,9{F{t,.,),t,_,)AFf + Y,9'iF{t,.,),t,.^)AFf + R, 
j=i j=i j=i 

where — > ucp. Applying (14. 5 p and Theorem 13.11 completes the proof. 
As a reminder, X„(t) ^ Yn{t) means that Xn — ucp. Let 

2[rat/2j 

Jn{9,t)= 9iF{t,.^),t,.,)AFfi-iy. 

Corollary 4.5 If g e C^'^M x [0,oo)), then 

Inig',t)^giFit),t)-giFiO),0)- dtg{F{s), s) ds - -Jn{g\t), 

where In{g,t) and Jn{9,t) are given by (ll.4p and (14.70 . respectively. Moreover, 

T4g',t)^g{F{t),t)-g{F{0),0)- [ dtg{F{s), s) ds, 

Jo 

where Tn{g,t) is given by l \1.7\} . 

Proof. By Theorems 13.21 13. 3^ and 14. 3^ it will suffice to show that 

[nt/2j 

J2 /(F(t2,-i),t2,-i)(AFj - AFj_i) ^ Ug",t). 
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As before, we may assume g has compact support. Note that 

Ln.f/2J 

J2 /(F(t2,_i),t2,-i)(A4 - A4_,) 

2[ni/2j 2[ni/2j 

i=i i=i 

j even j odd 

2[ni/2j 

= Jn{9'\t)- J2 {9"{F{t,),t,)-9"{F{t,_,),t,^,)}AFf. 

j odd 

The proof is completed by using (13.10p and applying Theorem I4.3[ □ 



5 Relative compactness 

The main result of this section is Theorem 15.11 below, from which the relative compactness 
of {Jn{9, ■)} "^ill follow as a corollary. (Recall that {Jn{9, ■)} defined in (14. 7p .) We will 
again need Theorem 15.11 later in Section [6l when we show that J„ converges weakly to an 
ordinary Ito integral. 

Theorem 5.1 Let g G C'^'^(]R x [0, oo)) have compact support. Fix T > and let c and d 

he integers such that < tc < td < T . Then 



E 



J2 {^?(F(Vi), Vi) -^?(F(g,tc)}Ai^2(-i; 

j=c+l 



< C\td - 1 



3/2 



where C depends only on g and T. 

Consider the simple case c = and g{x,t) = x. In that case, the above expectation is 



E 



d d 



J2F{t,.,)AFf{-iy =Y,Y.^[F{U-i)^F^F{t,.,)AF^]{-ir^^. 

j=l i=l j=l 



Using Corollary 14. 21 we can remove the AF^ factors from inside the expectation. The leading 
term in the resulting expansion would be roughly 



d d 



= At 5^ Emt,.,) - F(t,_2))(F(t,_0 - F(t,„2))]. 

i=l j=l 



t,j even 



We could now use (12. 8p to analyze these expectations and prove the theorem in this simple 



case. 



If we are to follow this strategy, then we shall need an estimate analogous to (12. 8p which 
applies to functions of F. The estimate in (12.80 was originally arrived at through direct 
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computations with the covariance function. Unfortunately, such direct computations are 
not tractable for a general function of F. There is, however, an alternative derivation of 
(I2.8p . Specifically, if we observe that \dstp{s,t)\ < C\t — s\~^/'^ , where dst is the mixed second 
partial derivative, then we may conclude that l-EfAFj AFj] | < CAt^|tj — Based on 

these heuristics, we begin with the following. 

Lemma 5.2 Let X he a centered Gaussian process with continuous covariance function 
p{s,t) and define V{t) = p{t,t). Suppose that p is a C"^ function away from the set 
{s = 0} U {t = 0} U {s = t}, and that V{t) is a positive function on {t > 0}. 
Suppose ip G C^(M) has polynomial growth of order 2 with constants K and r, and define 
V^{t) = E[ipiXit))]. Then 

In particular, \V^{t)\ < C\V'(t)\ for all < t < T , where C depends only on K, r, and T . 

Proof. Let a(t) = V{tY^'^ and note that a is a positive function on {t > 0}. Fix 
t > and let X = a{t)~^X{t), so that X is a standard normal random variable and 
V^{t) = E[ip{a{t)X)]. Since (p' has polynomial growth, we may differentiate under the 
expectation, giving 

V^it) = a'{t)E[X^'{a{t)X)] = ^E[^'(a(t)X)/.,(X)], 

where hn is given by (12.161) . By fl2.25p . we have 

V;{t) = 'Q^^E[a{t)^"{a{t)X)ho{X)] = ^V'{t)E[^"{Xm. 

□ 

Proposition 5.3 Let X, p, and V he as in Lemma \5.2[ Let g,h & C^(M) have polynomial 
growth of order 2 with common constants K and r, and define f{s,t) = E[g{X{s))h{X{t))]. 
Then 

dsfis^t) = ^V\s)E[g"{X{s))h{Xm + dsP{s,t)E[g'{X{s))h'iXit))] and (5.1) 
dj{s, t) = ^-V'{t)E[g{X{s))h"{Xm + dtp{s, t)E[g'{X{s))h'{Xm (5.2) 

whenever < s,t < T and s ^ t. In particular, 

\dJ{s,t)\<Ci\V'{s)\ + \dsp{s,t)\) and 
\dJ{s,t)\<C{\V\t)\ + \dtpis,t)\), 

where C depends only on K, r, and T. 
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Proof. By symmetry, we only need to prove (15.11) . Let a{t) = V{tY^'^ and note that a 
is a positive function on {t > 0}. Let r = r(s,t) = cr{s)~^cr(t)~^p{s,t) and define 
Xr = a{s)~^X[s) and Yr = a{t)"^X{t). Note that Xj. and Yr are jointly normal with mean 
zero, variance one, and £^[XrFr] = 

Let ip be as in Lemma [2.12[ Then f{s,t) = (p{a{s),a{t),r{s,t)). Hence, by Lemmas 12. 121 
and Em 

dj{s,t) = a'(s)a(s)i?[/(X(s))/i(X(t))] + a'(s)a(t)r(s,t)E[^7'(X(s))/^'(X(t))] 

+ dsr{s,t)a{s)a{t)E[g'{X{s))h'{X{t))]. 

Note that a'{s) = V'{s)/{2a{s)) and 

a r(, f^ = ^^^(^'^) _ P(g.^) N _ dspis,t) _ V'{s)r{s,t) 

Thus, 

dsf{s,t) = ^V'is)E[g"{X{s))h{Xm + ^V'{s)a{sr'a{t)r{s,t)E[g'{Xis))h'{Xm 

+ dsp{s, t)E[g\X{s))h\Xm - ^V'{s)a{s)-'a{t)r{s, t)E[g'{X{s))h'{Xm 

= ^-V\s)E[g'\Xis))hiXm+dsPis,t)E[g'iXis))h'iXm- 

□ 

Theorem 5.4 Let X, p, and V he as in Lemma \5.2[ Let g,h ^ C^(M.) have polynomial 
growth of order 3 with common constants K and r, and define f{s^t) = E[g{X{s))h{X{t))]. 
Then 

\dstf{s,t)\ < C\dstp{s,t)\+C{\V'{s)\ + \dsp{s,tm\V\t)\ + \dtp{s,t)\) 
whenever < s,t < T and s ^ t, where C depends only on K, r, and T. 

Proof. By (151|) . 

dstfis^t) = ^V\s)d,{E[g"iXis))hiXm} 

+ dsp{s,t)dt{E[g'{X{s))h'iXit))]}+dMs,t)E[g'{X{s))h'{Xit))]. 

Applying (15. 2p . we have 

dsJis,t) = ^V\s)V'it)E[g"iXis))h"iXm + ^V'is)d,pis,t)E[g"'iXis))h\Xm 

+ Iv'mpis, t)E[g'{Xis))h"'iXm + dsp{s, t)dtp{s, t)E[/(X(s))/^"(X(t))] 

+ dMs,t)E[g'{X{s))h'{X{t))], 
and the theorem now follows. □ 



From Theorem 15. 4[ we immediately obtain the following corollary. 
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Corollary 5.5 Let X, p, and V be as in Lemma \5.S[ Let g,h ^ C^(R) have polynomial 
growth of order 3 with common constants K and r, and define f{s,t) = E[g{X{s))h{X{t))]. 

If 

\V'{t)\ <ct-^'\ 

\d,p{s,t)\ + \dtp{s,t)\ < C{s-"^ + {t- and 
\dstp{s,t)\<C{s^'" + {t-s)-''^) 

for all < s < t < T , where C depends on only T , then 

|5.,/(s,t)|<C(s"3/2 + (t-,)-3/2), 

for a (possibly different) constant C that depends only on K, r, and T. 

With this corollary in place, we can now begin proving Theorem 15 .![ 
Lemma 5.6 Suppose g G C^'"'^(]R x [0, oo)) has compact support. If p > 0, then 

E\giFit),t) - giF{s),s)\P < C\t - s\P/\ 
for all < s,t < T, where C depends only on g, p, and T. 
Proof. We write 

g{F{t),t)-giF{s),s)= [ dtg{F{t),u) du 

J s 

+ {F{t)-F{s)) I g'{F{s) + u{F{t)-F{s)),s)du. 
Jo 

Hence, \g{F{t),t) — g{F{s), s)\ < C\t — s\ + C\F{t) — F{s)\. Since F is a Gaussian process, 
an application of (12.31) completes the proof. □ 

Lemma 5.7 Recall that (t| = EAFj. Under the hypotheses of Theorem \5.1[ 



E 



d 



j=c+l 



2 



< c\td - 1, 



3/2 



where C depends only on g and T . 
Proof. By (El, 



d 

J2 {g{F{t^.,),t,_,) - g{F{t,),t,)}a^{-iy = S + e, 

j=c+l 



where 

1/2 



/2\ ' 



j = C+l 
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and, by Holder's inequality, 

d 



e\'<CAt( \9iFit,^,),t,.,)-giFiQ,Q\r'/A 

^ j=c+l ^ 

<CAt( \9{F{t,.,),t,.,)-g{F{Q,QA( J 



J 

Hence, by Lemma I5.6[ 

d 

i=c+i 

As for S*, we assume, without loss of generality, that c and d are both even. In that case, 

1/2 



S=[-) At'/' {9intJ-l),t,-^)-giF{t,.,),t,.2)] 



j = C+l 

j even 



J even 



Using (13. 5p with j = 0, the integral is bounded by CAt, and we have £'|S'p < CAt{\tfi 
^cP + iSi + S2), where 
d 

S, = Y E\g{F{t,^,),t,^2) - 9{F{tj.2,tj^2))\', 



j=c+l 
j even 



d d 



S^ = ^Y1 Yl \E[{g{F{U.,),U.2)-9{F{U.2)A-2)} 



i=c+l j=i+2 
i even j even 



X {(7(F(t,„i),t,_2) -^7(F(t,-2),t,-2)}] 

E 



d d 

dstfij{s,t) dt ds 

ti-2 •^*j-2 



j=c+l j=i+2 
i even j even 



and fij{s,t) = E[g{F{s),ti^2)9{F{t),tj^2)]- Note that F is a Gaussian process satisfying the 
conditions of Corollary 15.51 Hence, 

d d 



i=c+l j=i+2 
i even j even 



s2<cY r~\s~'^'+{t-s)-'/')dtds 



d d 



< CAei' Y E ((^ - 2)-'/' + (j - ^ - 1)-'/') 

i=c+l j=i+2 
I even j even 

< CAt'/''{d -c) = CAr'/''\td - 
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By LemmaEH we also have 5*1 < CAt~'^/'^\td-tc\. Hence, £'|5'p < CAt^/'^\td-tc\. Combined 
with the estimate on this completes the proof. 



□ 



Lemma 5.8 Let acj = E[{F{tj^i) — F{tc))AFj]. Under the hypotheses of Theorem \5.1[ 



E 



E 9'\F{t,^^),t,^,)al/-iy 

j=c+l 



< CAt\td - 1, 



where C depends only on K, r, and T . 

Proof. By Lemma YIM i) applied with c = 0, and ( I2.9p . 

\dc,j + {2'RY^'^At^'^\ = \a, - E[F{t,)AF,] + {27iy'^^At'^^\ < CAt^/\j - 
Hence, by Lemma [2.9( i). 



-1/2 



Therefore, 



where 



and 



j=c+l 

d 

S={2'K)-'At J2 
i=c+i 

\e\^ < CAe ( 5Z (j - c)-^'^\ < CAt\d -c) = CAt\td - t. 



□ 



The proof that £'|S'| < C At\td — t^ is similar to that in the proof of Lemma 15.71 except 
that we must use (13.51) with j = 2. 

Proof of Theorem [SHI For brevity, let X{t) = g{F{t),t) - g{F{tc),tc), and write 

d 2 d d 



E 



J2 X{t,.,)AF}{-iy =Y. H E[X{t,^,)AF^X{t,.,)AF}]{-l) 

j=c+l i=c+l j=c+l 



i+j 



Recall that a| = EAFf. Let 5^{t) = F{t) - F{t,). Let = E5,{tjf. Let = F{t,), 
6 = a-lMti-i), ^3 = (T;]^Mtj-i), ^4 = ar'AF,, and ^ ='(^1, • • • ,^4)- For x G M^ define 
/ = fij by 



fix) 



g{xi + crc,i-iX2,ti_i) - g{xi,ti^i)\ [ g{xi + acj-iXa, - g{xi,tj^i) ^ ^ 

Xa ■ 



Let Y = ar^AFj and h{y) = y\ 
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Note that for 6 G (0, 1] and tj G [0,T], x t— 6~^{g{xi + 6x2,tj) —g{xi,tj)) has polynomial 
growth of order 6 with constants K and r, that do not depend on 6 or j. Hence, / has 
polynomial growth of order 6 with constants K and r. Thus, by Corollary 14.21 with k = 5, 
if cr = ac,i-i(Tc,j-i(Tfaj, then 

E[X{U_,)AF^X{t,.,)AF^] = aE[fm{Y)] 

where pj = E[^jY] and |-Ri| < C\p\^. If p is a positive integer, then by ( ]2.19p . (I2.20p . and 
i Km with r = 1, 

E[h\al{Y)YP] = ifp- |a| isoddor |a| >p. (5.3) 

Hence, since E[h2iY)Y^] = E[Y^ - Y^] = 2, 

E[X{U.,)AF^X{t,^^)AFf] = aE[f{0] + aplE[d',f{0] + aR^, 

where R2 incorporates all terms of the form p°'_E'[9"/(^)] with |a| = 2, except a = (0, 0, 2, 0). 
It follows that 

E[X{U^,)AF^X{t,,,)AFf] 

= a]E[X{U^^)AF^X{tj^,)]+al^E[X{U^,)AF^g"{F{tj^,),tj.^)]+aR2, (5.4) 

where acj = E[6c(tj_i)AFj] and 

\R2\ < C(|pip + IpaT + |P4| + IP1P2I + IpiPal + IP2P3I + IpsD- 

The terms |piP4|, IP2P4I5 IP3P4I! and |p4p are not hsted on the right hand side of the above 
estimate because \piP4, \ + IP2P4I + IP3P4I + |P4p < C'|p4|. Using (12. 3p and Lemma [2^9} we have 

1^1 <CA^3/2|,_c|l/^|J-c|l/^ 
\p2\<C\^-c\-'/\\J-^r/' + \J-c\-'/'), 
\p,\<CAt'/'\j-cr'/' 

<C\^-cr/\\J-^r'/' + \J-c\-'/'), 
\P3\ < C\j - c\-'/\ 
\p,\<C\J-^\-'/\ 

Note that the above factors of \j — i\ are actually (|j — i\ V 1), though we have omitted this 
to simplify the notation. These estimates now yield 

\aR2\ < CAt^^Wt - cI-i/^Ij - - t]-' + \t - c^'/^Ij - c\~'/^ 
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Using \j — c\ < \j — i\ + \i — c\ and |i — c| < \j — i\ + \j — c|, one can show that 

\aR2\ < CAt3/2(|, _ ^|l/4|^. _ ^|-5/4 ^ _ ^|-l/2 ^ _ ^|-l/2)^ 

and therefore, 

i=c+lj=c+l i=c+l 

By (15 ■4p . we are now reduced to considering the sums 

d d 

j=C+l J=C+1 

+ E E ^L•i?[^(^.-l)Ai^V(i^(^,-l),t,-l)](-l)^+^ (5.5) 

j = C+l J=C+1 

which will require two more applications of Corollary I4.2[ We will be brief in our presentation 
because the following estimates can be obtained in a way very similar to the one presented 
above. ^ _ _ _ 

For X eJR^, define /i(x) = /(xi,X2,X3, 1). Let y = ^4, ^ = (6,6,6) and pj = E[^jY]. 
Note that /i and /2 = o'cj-i^if both have polynomial growth of order 5 with constants K 
and r. Applying Corollary 14.21 with k = 4, and using (15.31) . 

a]E[X{U^,)AF^X{t,.^)] = aE[M)HY)] = aE[M)] + ^piE[dlM)] + ^^3 

= a^a^E[X{U^i)X{t,^i)] + dl,a^E[g"{F{U^i),U^i)X{t,-,)] + aRs, (5.6) 

where 

iRsl < C{\p,\' + Ipar + IP1P2I + IPiPsI + IP2P3I + IP2I'). (5.7) 

As before, 

\p^\<C\J-cr'/\\^-Jr/' + \^-c\-'/'), 
\pi\ < CAf/^\t-c\-^/^ 

<c\j-cr'/\\t-jr/' + \t-cr/% 
\P2\ < c\i - cr'/\ 

which gives 
and shows that 

d d 

E E WR3\<C\td-tcf'. (5.8) 

i=c+l j=c+l 
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Similarly, if a = a^jafac^i^i, then 

al^E[X{U^,)AF^g"{F{t,_,),t,^^)] = aE[M)hiY)] = aE[M)] +^p'2E[dlM)] +^R^ 
= a^aljE[X{U^i)g'\F{tj.i),tj^i)]+dlal^E[g'\F{U^,^ 

(5.9) 

where also satisfies (15. 7p . Note that |a| < CAt'^^^\i — c\^^'^. Since this is a better estimate 
than the one we use for \a\, the estimates above also give 



J2 E \^R^\<c\u-^'/'. 

i=c+l j=c+l 

By (15. 5p . (15. 6p . (15. Sp . (15. 9p . and (I5.10p . we are reduced to considering the sums 

d d 



(5.10) 



i=c+l j=c+l 



+ E E ^c',^ji^[/(i^(t.-i),t.-i)^fe-i)](-i)^+^' 

j=C+l j=c+l 

d d 



j=c+l j=c+l 

d d 

i=c+l j=c+l 

Note that this can be simplified to 

d d 2 

E a|x(t,_o(-i)^ + E 



j=c+l 



j=c+l 



< 



(d 2d 
E E ^]x{t,.,){-iy +E 
J=C+1 j=c+l 



□ 



By Lemmas 15.71 and 15. 8[ this completes the proof. 

Corollary 5.9 Recall Jn{g,t) from ( 14. 7p . If g G C'^'"'^(]Rx [0,oo)) has compact support, then 
{Jn{g,-)} is relatively compact in D^[0,oo). 

Proof. We shall apply Corollary 12.21 with (3 = 4. First note that q{x + y)^ < C(|a;p + |?/|^). 
Fix < s < t < T. Let c = 2[ns/2j and d = 2[nt/2\. Then 



E[q{Jn{t) - Jn{s)Y] < CE 



E {9{Fit,.,),t,.,)-g{F{tM}^Ff{~iy 



j=c+l 



CE 



g{F{t^),t^) E ^Ffi-iy 

j=c+l 
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By Theorem ED and (|2:T2|) , 

EUUt) - Ms)f] <C\U- t^f' + C\U- < c>|^ 2Lnt/2j-2LW2j ^ 

This shows that one of the assumptions of Corollary 12. 21 holds. The other assumption follows 
from the same estimate applied with s = 0. By Corollary 12.21 {Jn} is relatively compact. □ 

6 Convergence to a Brownian integral 

Recall that Jn{g,t) is given by (14.71) and is given by (12. lip . Note that Jn{g,t) = 

K c/(F„(s-),iV(s-))rf5„(s), where N{t) = [nt\/n and = F{N{t)). In light of 

Theorem 12.101 we would like to apply Theorem 12.71 Unfortunately, though, {-Bn} cannot 
be decomposed in a way that satisfies (12.21) . This is essentially due to the numerous local 
oscillations of 3^. To overcome this difficulty, we consider a modified version of Bn- 

The process i?„ has a jump after every At units of time. To "smooth out" this process, 
we shall restrict it so that it jumps only after every At^/^ units of time. Define 

2m^\mt/2\ 

B^{t) = K~' J2 ^Ffi-iy, (6.1) 
i=i 

where m = [n^^^J . 

Lemma 6.1 The sequence {Bn} given by (16. ip satisfies (12. 2p . and Bn — Bn ucp. 

Proof. Given k, let d = d{k) = 2m^k and c = c(/c) = 2m^{k — 1). Write 5„(t) = 
K-^ EI=*/^^ ^fc, where 

d 

i=c+i 

For c< i <d, let AFj = AF^ - F[AF,| J^^J, where Tt is given by fl233|l . Let 

i=c+i 

so that {^^.} is an iid sequence, by the remarks following (I2.13p . In particular, M„(i) = 
^1=1^^^ is a martingale. Let An = Bn — Mn- We must now verify (12. 2p . 
Since {AFj}'jL^_^-^^ has the same law as {AFj}'jL^, (12.121) implies 



2m3 2 



mk\=E 



F|Av5„(2m7n)|2 < Cn~^/\ 
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It follows that E[Mn]t = f^-^ Ei=r^ E\^k\^ < Ct for all n. Also, by 

j=c+l 

It follows that EVt{An) = k"^ Ei™^^ E\^k -^k\ < Ctn-^'^\ and satisfies (Q. 

By (ra, 



\ n 

By Corollary l2.2[ {Bn} is relatively compact. By Corollary 12.41 and Theorem 12. 10[ — i?„} 
is relatively compact. Hence, by Lemma [221 in order to show that i?„ — Bn — > ucp, it will 
suffice to show that Bn{t) — Bn{t) — > in probability for each fixed t. 

For this, note that n^^^ — 1 < m < n^l^. Hence, m'^[mt/2j < ntj^. Since m'^[mt/2j is 
an integer, m^\mtl2\ < [nt/2j. By (EH]), 



2[nt/2j 

E\B^{t)-Bn{t)\^ = E 



< c 

< C 



j=2irfi \mt/2\+l 

2[nt/2\ - 2m^[mt/2\ ^ ^ 
n 

nt — m t + 2m \ 



(6.2) 



n 

(nt-{n^/^-l)H + 2n'^/^\' 
-""l n ) • 

Letting n oo finishes the proof. □ 
With this lemma in place, we are finally ready to prove our main result. 

Theorem 6.2 Let In{g,t) be given by (11. 4p and n, Bn by (12.101) and (12. lip , respectively. 
Let B be a standard Brownian motion, independent of F. If g & C^'^(R x [0, oo)), then 
{F, Bn, Inig' , ■)) {F,B,I^^^{g',-)) in law m L'k3[0, oo), where I^'^{g\-) is given by (TO . 

Remark 6.3 Suppose {Wn} is another sequence of cadlag, M^-valued processes, adapted to 
a filtration of the form {JF^ V Qt}, where {J^t} and {^"} are independent. If (Wn, F, Bn) 
(W, F, B) in law in [0, oo), then {Wn, F, Bn, In{g' , ■)) ^ {W, F, B, I^'^{g', ■)) in law in 

D]R<+3[0, oo). This can be seen by applying Remark to (16.31) below. 

Proof. By Lemma EH] and Theorem 12. 101 Bn — -B in law. Define N(t) = 2m^\mt/2\/n and 
Tnit) = F{N{t)). By continuity, g"(Fni-), N{-)) c/"(F(-),-) a.s. Hence, by Corollary [22] 
andLemma[231 {F, g"{Fn{-), N{-)), Bn) {F, g"{F {■),■), B) inlaw in D^slO, oo). Therefore, 
by Lemma 16.11 Theorem 12.71 and Remark 12.81 



F,g"{Fn{-),Ni-)),Bn,n I g"{Fn{s-),N{s-))dBn{s) 

Jo 

F,g"{F{-),-),B,K g"{F{s),s)dB{s)^ (6.3) 
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in law in Dig4[0, oo). By Corollary 14.51 and Lemma [6. 
(F,5„,J„(^?',t)) 

^ (^F,B^,g{F{-),-)-9{F{0),0)- dtg{F{s),s)ds-^J^ g"{K{s-), N{s-)) dB^is)^ 



-i(0,0,Cn(t)), 

where 



Ut) = Jn{g",t)-K / g"{Fn{s-),N{s-))dB^{s). 



Hence, it will suffice to show that Cn ^ ucp. 

By (16.11) . Bn jumps only at times of the form s = 2k /m, where k is an integer. At such 
a time, N{s—) = 2m^{k — l)/n and ) = F{N{s—)). Using the notation in the proof 



of Lemma 16.11 this gives 

K [ g"(F4s-),N{s-))dBn{s) 
Jo 

J2 g"{K{s-),N{s-))ABr,is 



= K 

0<s<t 

\mt/2\ 2m3fc 

k=l j=2m^{k-l)+l 
lmt/2\ d 

k=l j=c+l 

Hence, by g2D, Cn(t) = Et=f ^ Sk + Sn, where 

d 

^fc= E {9"m,_,),t,.,)-g"{F{Q,Q}AFf{-iy (6.4) 

j=c+l 

and 

2[nt/2j 

en= Yl 9"{F{t,.,),t,.,)AFf{-iy. 

j=2m^[mt/2]+l 

By the truncation argument in the proof of Theorem [221 we may assume that g has compact 
support. Hence, by Corollary 15. 9[ {Jn{g",-)} is relatively compact, so by Corollary 12.41 and 
(16. 3p . {(n} is relatively compact. Therefore, by Lemma 12. 6[ it will suffice to show that 
Cnit) ^ in probability for fixed t. 

If M = 2m^lmt/2\ and N = 2lnt/2\, then 

N 

en= {9"iF{t,.,),t,.,)-g"{FitM),tM)}AFf{-iy 

j=M+l 

N 

+ g"{F{tM),tM) Y ^F'i-^y- 

j=M+l 
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Note that g" is bounded and, by flCTD and (12:T2|) . 



E\Bn{N/n) - S„(M/n)|^ < - Im?. 



<C\tN-tM?'^. 



N 

E y: ^F]{-r 

j=M+l 

As in ( I6.2p . this goes to zero as n — > cx). Also, by Theorem 15.11 

N 

E E {g'\nh-i).t,-,)-g'\F{tM)Mi)]^F^{-iy 

j=M+l 

Hence e„ — > in probabihty and it remains only to check that X]i=i^^^ S'fc ^ in probability. 
Still using the notation from the proof of Lemma 16. ![ let 

d 

Sk=Y. {9"mj-i),tj-i) - g"iF{Q,Q}AF'i-iy, (6.5) 

j=c+l 



let rrik = E[Sk\J^tc]y l^t A^^ = — rrik- We claim that 

E\Sk-Nk\^ < CAt^/\ 
For the moment, let us grant that this claim is true. In that case, 

[mt/2j lmt/2\ ^ \mt/2\ 2n 1/2 



(6.6) 



E 



Su < E\Sk-Nk\ + {e ] 

k=l k=l ^ k=l ' 



Since m_J rt^l^ = AT^^^^mM gives ES*/^^ E\Sk - A^fc| < CAt^/^^ 0. Also, if A; < 
then E[NkN,] = E[N,E[Ne \ J't^J] = 0. Hence, 



E 



\mt/2\ 2 \mt/2\ \mt/2\ \mt/2\ 

Y^^ = J2 EnI<C Y E\Nk-Sk? + C Y ESl 

k=l k=l k=l k=l 

As above, the first summation goes to zero. For the second summation, note that 
g" G C^'^(]R X [0, oo)) has compact support. Thus, by fl6.4p . Theorem 15.11 and the fact 
that d-c = 2m^ < 2At-^/^, 



ESl = E 



Y {/(F(t,-i), Vi) -/(F(g,g}Ai^^(-l)^- 

j=c+l 



< c\ta _ t//2 = cAt^/\d - c)3/2 < CAt^/\ 

Hence, Efc=i''^^ ES^ < CAt^/^ 0, which completes the proof of theorem. 
It remains only to prove (16.61) . By (16.41) and (16.51) . 



E\Sk — Sk\'^ = E 



Y {9"{F{t,.,),t,.,) - g"iF{Q,Q}{AFf - AF%-iy 



j=c+l 



<id-c) Y E[\g"iFit,.,),t,^,) - g"{FiQ,Q\'iAFf - AF 

j=c+l 
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By Holder's inequality, Lemma [5.61 and fl2.15p . 



d 

E\Sk -Sk\'< C{d - c) ^ {tj - Q'/'AtU 

J=C+1 

d 

j=c+l 

Hence, it will suffice to show that E\mk\'^ < CAt^^^. 
By (B, 

d d 

mu=Y. E[g"{F{t,,,),t,.,)AF]\T,:,{-iy - ^ g" {F{Q,QE[AF'^{-iy 

j=c+l j=c+l 

d 

= J2 i5[/(G(V._i)+X,_„t,„i)AG|„J^J(-l)^- 

j=c+l 

d 

- E 9"iF{Q,QE[AGl2{-iy, 

j=c+l 

where G{t) = F{t + t^) - E[F{t + | ^tj and Xj = E[F{tj+c^i) \ TtX As noted in the 
discussion following f l2.13p . G is independent of Tt^ and has the same law as F . Thus, 

d—c d—c 
J even j even 

where (/^^(x) = +x, tj+c-i)AF/]. Using ([225]), if = EFitj.xf, then we have 

= a|E[/(F(t,_i) + x,t,+e_i)] 

^a]{E\a~'F{t,^,)a.'AF,\fE\a^g^'\a{a''F{t,^^^^ 
= a]E[g"{F{t,.^) + x,t,+,.^)] + AF,])2E[(7(^ni'(^j-i) + a^, 

where 

c,(x) = E[(7('^)(^(Vi)+a;'^.-+-i)]. 

We may therefore write 

d—c 5 

Mfc = ^ ^i^i, (6.7) 

J even 
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where 



^i = (a|-a|„i)6,(X,), 

£2 = ^|_i(6,(X,)-6,_i(X,_0), 

£4 = a|_i(cj(Xj) - Cj_i(Xj_i)), 
S, = -g"{F{Q,Q{a]-a]_,). 

For Si, (I23D gives ja^ - a? J < Cj-^/^At^/^. Hence, 



d— c 
J even 



< CAt. 



The same estimate also apphes to S^. For S2, let us write 

\bj{xj) - bj_i{xj_i)\ < \bj{xj) - bj{xj^i)\ + \bj{xj_i) - 
^ C \xj X J _ 1 1 

^ I X J X _ 1 1 

+ |E[^7"(F(t,_i) + - /(F(t,-_2) + 

+ \E[g"{F{t,_2) + - g"{F{tj_2) + x,_i,t,+,_2)] 

< Clxj - Xj^il + \p2ii*)\^t + CAt, 

where /?2(^) = -E'[fi'"(-^(^) + a^i-i, ^i+c-i)] and t* G (tj^2,tj^i), and we have used (13.51) with 
j = 2. By Lemma ESI \p2{'t)\ < Ct~^/^. Also note that Xj - Xj^i = E[AFj+c^i \ J^t,], so 
that by (EUD, E\Xj - Xj_i\^ < Cj-'^^^At^/^ Thus, 



E 



d—c 2 / d—c 



3=1 
j even 



d—c 



d—c 



< CAt'/' ^ ^-1^^) 

For S3, gives |a| - < CT^/^At. Hence, 



(6i 



d—c 
J even 



< CAt2(d-c) < CAt^/^ 



For S4, as above, we have 



\cjixj) - Cj.i{xj.i)\ < C\xj - + \P^{t*)\At + CAt, 
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where P4,{t) = E[g^^\F{t) + tj+c-i)] and t* E (tj_2,tj-i), and we have used (13. 5p with 
j = 4:. It therefore follows as in (16.81) that 



E 



d- 



j even 



2 



Applying these five estimates to (16. 7p shows that i?|mfcp < C/S.t^^^ < CAt^^^, and completes 
the proof. □ 

Corollary 6.4 Let ^ be a stochastic process, independent of F , such that (II. 3p holds. Let 
X = cF + i, where c G M. Let 1^(9, t) be given by (11.40 and k, Bn by (I2.10p and 
(12. lip , respectively. Let B be a standard Brownian motion, independent of {F,C,). If 
g G C9'i(M X [0,oo)), then {F,i,B^J^{g' ,■)) (F, 5, /^'^'^(^', ■)) law m Dm4[0,oo), 
where l^^ is given by (11.60 . 

Remark 6.5 Recall from Section [1] and note that = nBn- Note that 

^ c^Qnit) because AX^ = c^AF^ + o{At). This and Corollary [631 imply that 
(X, Q^, I^{g', ■)) ^ (X, Kc25, 1'^'^'^ig', ■)) in law in D^^O, oo). 

Remark 6.6 Suppose {Wn} is another sequence of cadlag, M^-valued processes, adapted to 
a filtration of the form {JF^ V Q^}, where {J-^t} and {^"} are independent. As in Remark 
MM if in law in ^^.+2 [0, cx)), then (1^,, F, /^(^', ■)) ^ 

in law in D^e+40,oo). 

Proof. The claim is trivial when c = 0. Suppose c 7^ 0. We first assume ^ is deterministic. 
Let h = h^he given by h{x,t) = g{cx + ^(t),t). We claim that h e C^'^(R x [0, 00)). Note 
that h^^\F{t),t) = c^g^^\X{t),t) for all j < 9. It is straightforward to verify fl3:^- fl33|) . 
Conditions (I3.4p - (l3.5p follow from the fact that 

dth^^\x,t) = c^g^^+'\x + m,t)^'it) + c^dtg'-'Kx + (6.9) 

for all j < 8. 

Observe that 

[nt/2\ 

I^{g',t)=Uh\t)+C-' J2 h'{F{t2,-,),t2,-imt2,)-at2,-2)). 

i=i 

By our hypotheses on ^, and the continuity of h' and F, the above summation converges 
uniformly on compacts, with probability one, to h'{F{s), s)^'{s) ds. Thus, by Theorem 
EJand Remark ESI (F, ^, (^', ■)) iF,^,B,I), where 

X=h{F{t),t)-h{F{0),0)- [ dth{F{s),s)ds-'^ [ h"{F{s), s) dB{s) 

Jo 2 Jo 

+ / h'{F{s),s)eis)ds. 
Jo 
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Using (16.91) with j = 0, this gives 



I=g{X{t),t)-g{X{0),0)- f dtg{X{s), s) ds - ^ f g"{X{s), s) dB{s), 

Jo ^ Jo 

completing the proof. 

Now suppose ^ is random, and independent of F. Let H : -Dk4[0, oo) ^ M be bounded 
and continuous. Since we have proven the result for deterministic C,, it follows that 

E[H{F,^,B^,I^ig',.)) I - E[H{F,^,B,l'''^'^{g',.)) \ ^] a.s. 

Applying dominated convergence completes the proof. □ 

We now give two examples of processes X satisfying the conditions of Corollary 16.41 

Example 6.7 Consider the stochastic heat equation dfU = \d1u + W{x,t), with initial 
conditions 0) = f{x). Under suitable conditions on /, the unique solution is 

u{x,t) = / p{x — y,t — r)W{dy X dr) + v{t, x), 

jRx[0,t] 

where 

v{t,x)= / p{x -y,t)f{y)dy. 
Ju 

For example, if / has polynomial growth, then this is the unique solution and, moreover, 
dtv is continuous on M x [0, oo). This implies that t t— > v{x,t) satisfies (11. 3p . Hence, 
X[t) = u{x,t) = F{t) + v{x,t) satisfies the conditions of Corollary 16.41 This remains 
true when / is allowed to be a stochastic process, independent of F. 

Example 6.8 This example is based on a decomposition of bifractional Brownian motion 
due to Lei and Nualart [8]. Let be a standard Brownian motion, independent of F. Define 

POO 

^(t) = (167r)~^/^ / (1 - e-'')s~^/^ dW{s). 
Jo 

By Proposition 1 and Theorem 1 in [S], the process ^ satisfies (II. 3p . Moreover, if c = (7r/2)^/'^, 
then X = cF+^ has the same law as B^^'^, fractional Brownian motion with Hurst parameter 
H = 1/4. 
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